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ABSTRACT 

An audio-tutorial learning system for college 
students studying intermediate algebra was developed by a member of 
the mathematics staff and was directed by student assistants. An 
analysis of covariance design was used to determine if students 
receiving help from student assistants did significantly better than 
those not receiving help. Results showed that when initial abilities 
in mathematics (as determined by Blyth Algebra pretest and College 
Entrance Examination Board scores) were held constant, the group 
receiving no help had a significantly higher Blyth Algebra posttest 
mean score. Both groups achieved significantly above the national 
average . ( Aut hor/DT) 
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ABSTRACT 



An audio-tutorial learning system for college students studying 
intermediate algebra was developed and directed by student assistants. 
A member of the mathematics staff developed the system and assigned 
final grades. Otherwise, the mathematics staff was not involved. 

An analysis of covariance design was used to determine if 
students receiving help from student assistants do significantly 
better than those not receiving help. Initial abilities in mathematics 
as determined by Blyth Algebra pretest, discriminatory analysis, and 
College Entrance Examination Board scores were held constant. The 
group receiving no help had a significantly higher Blyth Algebra post 
test mean score when the Blyth Algebra pretest and College Entrance 
Examination Board scores were held constant. Both groups achieved 
significantly above the national average. 

It was concluded that college students capable of directing 
their own learning can successfully master intermediate algebra 
concepts when the students are placed in a well defined self pacing 
audio-tutorial learning system. Students faced with no teacher help 
available may work more intensely and achieve at a significantly higher 
level than students receiving help on a systematic basis. Instructional 
cost for precalculus mathematics instruction may be reduced by as much 
as forty percent over a five year period* 
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PREFACE 



This research report is the culmination of a project which 
began in the summer of 1971. Much credit for the research proposal 
as originally conceived goes to Dr. Willis Alderson, former assistant 
to the President, Hendrix College. His encouragement was a source of 
strength as the project went through various forms of revision. It 
would be remiss if special appreciation were not given to Dr. Burvin 
C. Alread, the contracting officer for Hendrix College and Mr. Rodney 
Todd, chief accountant and business manager for their advice in 
connection with record keeping, interim reports, and expenditures. 
Finally, no value can be placed on the contribution that Pat Huggler, 
Debra Roberts, Cathy McLendon, and John Lovett made to this research 
project. Each was dependable, competent, and dedicated. Each 
assisted the project director by carrying out instructions affecting 
the research in such a way that no crisis was experienced during the 
eighteen month duration of the project. Their selection as assistants 
proved to be extremely wise. 
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I. INTRODUCTION 



Purpos e of the Study 

The purpose of this study was to develop a program of individ- 
ualized instruction for students not adequately prepared for elementary 
functions, the first course in mathematics at Hendrix College, Students 
not prepared for elementary functions as determined by a discriminatory 
analysis guide were placed in an intermediate algebra learning 
sequence. The sequence utilized an audio-tutorial learning system 
based on an audio-tutorial text, keyed in tapes and filmstrips, and 
problem sessions. The student T s progress was measured by using a 
standardized pretest, unit tests, and standardized post test. The 
student's attitudes were measured by an attitude survey. 

Local Implications of t he Study 

The Hendrix College mathematics department developed a discrimi- 
natory analysis guide in 1971 for the purpose of placing students in 
either calculus, elementary functions, or contemporary mathematics. A 
copy of this guide is in Appendix A, The traditional two term sequence 
in algebra and trigonometry was removed in the spring of 1971 and * 
replaced by a more rigorous one term course in elementary functions. 
It was anticipated at the time of this proposal that 130 to 150 
students would take elementary functions each of the school years 

1971- 72 and 1972-73, Because of the lack of high school preparation 
it was anticipated that 20 to 30 of 4 these students would need to 
participate in an intermediate algebra course during each of the school 
years 1971-72 and 1972-73. It should be noted that 116 students took 
elementary functions during the school year 1971-72 and 147 during 

1972- 73 and 78 participated in an experimental intermediate algebra 
course during 1971-72 and 1972-73. The situation was predicted and 
turned out to be one that provided an opportunity to conduct some 
research related to the development of an efficient learning system 
that would solve a problem and make it possible for a mathematics staff 
to reallocate its time without affecting the precalculus mathematics 
instructional program. 



General Overview of the Learning System and Cost Factors 

The learning system developed and used in the experiment 
associated with this project was designed specifically for college 
mathematics instruction using the particular combination of instructional 
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devices: a discriminate analysis placement process, an audio-tutorial 
text, keyed in Cassette tapes and filmstrips, a standardized pretest, 
unit test, a standardized post test, a student coordinated testing 
program, and problem sessions. The system \;as developed by this 
researcher with assistance from a mathematics education student, Debra 
Roberts, and then operated by two mathematics majors, Pat Muggier and 
John Lovett. Although some components of the system vjere developed to 
meet the specific needs of llendrix College freshmen mathematics 
students, the organisational structure was developed in such a way 
that it can be readily adapted to other colleges. As will be made 
clear in this report, the learning system can be. used to reallocate 
staff resources, yet efficiently teach elementary precalculus mathe- 
matics concepts. The total cost for 76 students Uiking intermediate 
algebra by traditional instruction would have been $3750.00 or $53.00 
per student. This figure is based on the salaries of the two instruc- 
tors who would have devoted 12.5% of their time to the courses. 

If the system had not been in an experimental mode, that is no 
experiment had been conducted, the cost would have been $3040.00 or 
$40.00 per student. This figure includes $780.00 for student help, 
$1760.00 for equipment and materials, and $500.00 for supervision, 
student placement, and student evaluation by the mathematics staff. It 
is easy to see that the second year the system operates the cost of 
equipment is reduced and therefore total cost is reduced. It is this 
researcher's opinion that the system would only cost $32.00 per student 
over a five year period whereas regular instruction would be about 
$60.00 considering increased salaries. Although these figures are 
based on the situation at Hendrix College, do not include indirect 
costs which are the same for either method of instruction, and relate 
to 76 students, the comparisons in cost of teaching methods with 
similar results is dependable and significant. 

The Learning System — Operational Details 

A freshman at Hendrix College is placed in either calculus, 
elementary functions, or contemporary mathematics (a general education 
non-skills course). Students placed in contemporary mathematics but 
desiring to take elementary functions at some future time are 
encouraged to enroll in "Math Lab." Math Lab utilizes the learning 
system developed in this project. It is a credit no-grade course and 
is strictly preparation for elementary functions. It does not meet any 
mathematics requirement but is counted as an elective toward the 36 
courses required for graduation. 

Students assigned to Math Lab assemble together the evening of 
the first day of classes for the term. A mathematics instructor 
describes the learning system in which each student participates. 
During the course of the experiment outlined in the next section of 
this report, this researcher described the system and randomly assigned 
students to the experimental and control sections. Students' 
schedules are studied and ten class periods set up each week as help or 
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testing sessions. This is done in such a way that each student can 
receive help or t;.ke a test at least three tiras each week. During the 
experiment students receiving no help wore not aUov/ed :.c a"wcud prob- 
lem sessions. 

During the Math Lab opening class session the audio-tutorial 
text is discussed in detail and the manner in which the Cassette tapes 
and filmstr'ps ai e to be used is described. Equipment such as tape 
players, earphones, and fiiisstrip viewers are demonstrated and then 
located in a rooir. in the main college library- Four work stations are 
made available for use by Hath Lab students. Record forms ore ';iven to 
each student and each is encouraged to record the time actually devoted 
to the course including problem sessions and test sessions. Duriu:; the 
course of the experiment the record forms were occasionally checked so 
as to encourage record keeping. Clocks are provided in the .Math Lab 
testing roon: and in the library study room for convenience. 

With these instructions the Uath Lab becomes operational. Con- 
sider student A. The first convenient: period (one of the te.i periods 
set up in the opening class session) student A comes to the Math Lab 
testing room and lakes the standardized pretest given by student 
assistants. A file for .student A is established and his pretest S'ore 
recorded. Student A then starts the course. After studying unit one 
and working various types of stvJy exercises, viewing the films pro- 
vided, and listening to tape lectures related to the material, the 
student comes in at an appropriate time and takes unit tes 1 - one. He is 
careful to record the time devoted to unit one. Unit one test is 
administered by a student assistant and the score recorded. If the 
student make 70% or better he is allowed to go on to the next unit. 
If the student makes less than 70% he must take an alternate form of 
the unit test when he is better prepared. This process is continued 
until all 14 units are completed. After the last unit test has been 
successfully completed the student takes a standardized post test, 
turns in his time sheet, completes an attitude survey intended as a 
monitor on the operation of the program, and therefore completes the 
course. At the end of the term the student assistants turn in the 
files on all students to the chairman of the mathematics department. A 
grade of P is given to all students who complete twelve .units with a 
minimum of 70% on each unit or a post test score of 26. x If a student 
does not complete either of these criteria and does not plan to do work 
during the next term, the student can drop the course with appropriate 
notification in accord with college regulations* If the student docs 
not complete 14 units and plans to complete the course during the next 
term, the student is given a grade of I and one additional term to 
complete the course. During the experiment, all students were given 
exactly one term to complete the course. 



The June 9, 1972 Progress report indicated that a student must 
have a minimum score of 60% on 12 units or a post test score of 21. 
This standard was updated after a careful analysis of the data obtained 
from the trial run during the spring of 1972. 



Related LLlornturo 



Experiments using linear prograws, branch programs, conptueri svd 
instructions, video capes, and oral prosraumim* hnve been conduced 
throughout the United States with soi«e significant results. Industry 
and the armed set vices have developed learning packages that are 
c-xtrencly effective in trie sense that facts are retained and pitied 
successfully over :*0-90 da> periods without reinforceinunl • The 
Project, the Hcs.-drl:: ExporM Tent , and the PLAX oral progiv.:: c\/evl- 
ment are pies of pic^rar/; it! individualized instruction in './men 
this researcher has utilised educational technology in forrLnr; nev 
educational patterns. These programs relate to teachers, eJ orient, * ~ 
or secondary school children, or elementary forns ol learning — but n,n: 
speci fica 1 ly to college saathexarict students, These pro^ra-ns uii!i?e 
only one or tv:o methods of presenting concepts. In fact, this 
characteristic of uost experiments currently being conducted which 
relate to individualized instruction. 

The experiment described in this project involves tvo compete 
learning systems, components of which give a new linear ordering but 
each component or Learnirg experience was selected in accord wiuh 
recent research findings. The educational technology used was selected 
so as to ;naxi;aize the learning of a given unit. 

The audio-tutorial materials developed under Project 70 at 
Fullcrton, California were utilized. Copies of the audio-tutorial 
text, Intermediate Algebra > by Gus Klcntos and Joseph Nevmyer which rnsae 
out oi Project 70 were purchased from Charles E. Merrill Publishing 
Company, Tradition flli&strips were keyed into three of the 14 uirUs 
selected for the experiment using a Bell and Howell Cue recorder and 
Singer synchronized Cassette films trip viewers. Audiotronic players and 
headsets were used in four student carrels. 



II. EXPERIMENTAL METHODS 



Description of the Comparable Learning Systems 

Two audio-tutorial learning systems were developed and compared. 
The following is a linear ordering of the components of each of the 
systems. 

Learning system a consists of 7 components. 

1. Each student was placed in Math Lab based on a discriminatory 
analysis guide and student need for preparation for elementary 
functions. Placement in experimental group a was done using 
random numbers. 

2. A one hour introduction to the learning system was given by a 
mathematics instructor for the entire group. When enrollment 
w..s completed, record forms were established for each student. 

3. By il:ili£ing student schedules, ten hours each week were set 
up as test sessions so that each student had at least three 
hours available for testing. This ten hour schedule is 
referred to as the Math Lab schedule. 

4. A Blyth Algebra pretest was completed at the student's con- 
venience within the limits of the Math Lab schedule. 

5. The student worked through 14 units of intermediate algebra 
using audio-tutorial text, filmstrips, and Cassette tapes. A 
unit was completed after a unit test score of 70% was obtained. 
Two forms of each unit test were available. All unit tests 
were administered by student assistants during the scheduled 
ten hour test sessions. The student recorded the time devoted 
to each unit of study. 

•6. The Blyth Algebra post test was taken after unit 14 was com- 
pleted or at the end of the term. 

7. An attitude survey was completed by the student and the record 
of time devoted to the course was placed in the student's 
record file. 

Learning system £ consists of the components of learning system 
a and an a'ldil'onal component. Briefly the components for 3 are: 
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1. 



Student placement. 



2. One hour introduction and establishment of record forms. 

3. Development of Math Lab schedule. 

4. Blyth Algebra pretest. 

5. Work through 14 unit<^ ' " -lished procedure. 

6. A student may receive . uxp from che student assistants at 
the student's convenience within the limits of the Math Lab 
schedule. This is the additional component. 

7. Blyth Algebra post test. 

8. Attitude survey and record of time form. 

The students assigned to learning system a will be referred to 
as experimental group a. The students assigned to learning system 3 
will be referred to as control group 6. Group a received no help. 
Group g received help. Tables 1 and 2 indicate the learning experi- 
ences by unit for groups a and 3. Appendix B provides a list of the 
topics treated in the 14 units. 



Audio-Tutorial Methods 

In the study of mathematics, most students are accustomed to the 
traditional lecture-textbook method where they read a certain section 
in the text, go to class to hear a lecture on the material, then are 
left to try to work the exercises. The frustrations of this type of 
situation are many. First, most students have difficulty reading a 
mathematics textbook; second, once the classroom lecture is over, the 
chalkboard is erased and the explanatory lecture is lost; and uhird, 
many students have great difficulty working the homework assignment a 
few hours after the lecture. 

The audio-tutorial materials used in this experiment are an 
attempt to remedy the defects of the traditional lecture-textbook 
method. In the audio-tutorial approach, the lecture and other explana- 
tions are put on audio tape. The chalkboard illustrations are put in 
the text. Therefore, each student has a permanent record of the 
material generally presanted in the classroom. The student may go 
through the lecture at his own rate, and any part of the ]ecture may be 
reviewed as often as desired by simply reversing the recorder and turn- 
ing back a few pages in the text. 



Experimental Design and Methods of Procedure 

Two audio-tutorial learning systems were compared. The time 

scheduled for each system was 68 days including 18 week-end days. 
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TABLE 1 



LEARNING EXPERIENCES BY UNIT 
EXPERIMENTAL GROUP a 



















Unit 












Learning 
Experience 


t 

JL 


2 


3 


4 


5 


6 


7 


8 9 


10 


11 


12 


13 


14 


Description of 
Math Lab 


X 


























Blyth Algebra 
pretest 


X 


























View filmstrip 
with sound 






X 








X 




X 


X 








Read audio- 
tutorial text 


X 


X 


X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X 


Listen to tape 


X 


X 


X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X 


Attend problem 
sessions 


Take unit test 


X 


X 


X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X 


Pick up test 
results 


X 


X 


X 


X 


X 


X 


V 
4V 


X X 


X 


X 


X 


X 


X 



Blyth Algebra 

post test x 



Attitude survey 



TABLE 2 



LEARNING EXPERIENCES BY UNIT 
CONTROL GROUP 3 



















Unit 












Learning 
Experience 


1 


2 


3 


4 


5 


6 


7 


8 9 


10 


11 


12 


13 


14 


Description of 
Math Lab 


X 


























Blyth Algebra 
Pretest 


X 


























View films trip 
with sound 






X 








X 




X 


X 








Read audio- 
tutorial text 


X 


X 


X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X 


Listen to tape 


X 


X 


X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X 


Attend problem 
session 


X 


X 


X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X 


Take unit test 


X 


X 


X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X 


Pick up test 
results 


X 


X 


X 


X 


X 


X 


X 


X X 


X 


X 


X 


X 


X 


Blyth Algebra 
post test 


























X 


Attitude survey 


























X 
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System a was characterized by the fact that students could not 
receive any help from the student assistants operating the Math Lab or 
from any member of the Hendrix College Mathematics faculty. System 6 
was characterized by the fact that students could receive help from the 
sluvIci a l assistants operating the Math Lab but could not receive help 
from members of the Hendrix College Mathematics faculty, 

A trial run of the two learning systems defined in a previous 
section of this report was carried out in the spring of 1972. The 
instructional materials were developed and debugged. Adequate record 
forms, standardized tests, audio-tutorial text, and audio-tutorial 
instructional aids were operational by June 15, 1972. Fourteen 
instructional units were selected and two sets of unit evaluations 
prepared. An experimental group of 16 students participated in a trial 
run of the learning system during the March 15-June 1 spring term. As 
a result of this trial run, a research design was selected and the two 
audio-tutorial learning systems a and g were made operational 
during the first and second terms of the 1972-73 school year, A 
significant objective of this project was achieved when it became clear 
that by June 15, 1972 an audio-tutorial learning system for inter- 
mediate algebra had been developed. This had been done in such a way 
that selection procedures, instructional materials, machines, and 
directors of learning activities functioned as a manageable unit; that 
is, the system could be controlled, monitored, and placed in an experi- 
mental data gathering mode. 

The analysis of covariance design was selected and used to 
evaluate learning systems a and 3. Since not all data to be used in 
the control variables could be gathered, three different analysis of 
covariance F ratios were computed. The variables held constant in each 
of the procedures were Blyth Algebra pretest, discriminate analysis V 
score, and College Entrance Examination Board Mathematics score. An 
attitude survey was developed to compare the students 1 attitudes toward 
various components of each learning system. The Olivetti Underwood 
P101 computer was used to analyze ail data with programs developed by 
the project director and Cathy McLendon, a senior mathematics major. 
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Ill, RESULTS 



An analysis of covariance design was used to test the difference 
between post test means of experimental group a and control group 6. 
Since three different variables were held constant, three analysis of 
covariance treatments were carried out. Tables 3 and 4 give the data 
used in the three treatments. Tables 5> 6, and 7 show the analysis of 
covariance summary tables. When pretest scores were held constant 
there was a significant difference at the ,01 level between the post 
test means of group a and group 3 with group a having the higher 
mean score. When discriminate analysis V scores were held constant 
there was no significant difference at the ,01 level between the post 
test means of group a and group $, When the College Entrance 
Examination Board Mathematics scores were held constant there was a 
significant difference at the ,01 level between the post test means of 
group a r.ad group 3 with group a having the higher mean score. 

An F statistic was computed to test the null hypothesis 
H q : °ct = a g against the alternate hypothesis H^: ° a i °$ • Table 8 
gives the results associated with this statistical test, H Q was 
accepted at the 0,01 level. 

Several other statistical studies were carried out although some 
were not mentioned in the project proposal. Appendix C charts the 
number of hours devoted to the course by each student in both group a 
and 3. Table 9 provides a statistical analysis of the time devoted to 
the course. There was no significant difference between the mean scores 
for the two groups. It should be noted that 15 of the 31 students in 
group a devoted over 30 hours to the course while only 9 of the 27 
students in group g devoted over 30 hours to the course. Appendix D 
gives the final grades assigned to each student in both group a and 3* 
A grade of P was pass and a grade of F was fail. Only one student in 
group a failed the course. Four students in group 3 failed the 
course. It should be noted that the failure rate of approximately ten 
percent is slightly less than the thirteen percent failure rate 
experienced from 1967-71 in college algebra courses at Hendrix College, 

The unit test played a role in motivation in the course in that 
a student could not go on to the next unit of study without making a 
score of at least 70% on a unit test. Each test had 20 questions and 
two forms of each unit test were available, A particular unit test for 
a particular student was selected in a random manner. If a student had 
to take a unit test r second t:me, then the alternate test was given. 
Appendix E indicates there vjas a Pearson r correlation of 0,611 between 
unit test average scores and post test scores for group a and a 
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TABLE 3 



GENERAL DATA 
EXPERIMENTAL GROUP a 





otuuenc 




PT?T7P 


V 


Dlytn Algebra 


UOUc 


rrecesc 


Matn 


Score 


Post test 


1 


20 


580 


1.03 


33 


O 
Z 


23 


590 


0.85 


25 


o 

J 


16 


480 


0.60 


22 


/ 


16 


X 


X 


24 


5 


24 


600 


X 


40 


0 


12 


450 


X 


35 


"7 
/ 


6 


470 ■ 


X 


34 


o 
o 


17 


X 


X 


29 


n 

y 


21 


450 


0.32 


25 


1U 


12 


450 


0.46 


30 


11 


18 


390 


0.27 


32 


12 


23 


X 


X 


37 


13 


18 


540 


-0.08 


24 


14 


20 


370 


0.33 


35 


15 


30 


X 


X 


41 


16 


15 


X 


X 


30 


1 7 
x / 


i «; 

± J 




n 9/i 


Q Q 
JO 


18 


25 


450 


0.10 


39 


19 


29 


420 


0.63 


36 


20 


11 


380 


-0.15 


22 


21 


21 


530 


0.65 


36 


22 


33 


500 


0.92 


45 


23 


13 


X 


X 


30 


24 


19 


500 


X 


28 


25 


19 


470 


0.70 


36 


26 


33 


670 


X 


40 


27 


14 


480 


X 


24 


28 


21 


490 


0.34 


33 


29 


18 


450 


0.11 


31 


30 


23 


510 


X 


40 


31 


16 


430 


-0.43 


25 
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TABLE 4 



GENERAL DATA 
CONTROL GROUP 8 



Student 


Blyth Algebra 


CEEB 


V 


Blyth Algebra 


Code 


Pretest 


Math 


Score 


Post test 


1 01 








9^ 


1 09 


XV* 


AID 

H J.W 


0 9Q 




J. \J ~> 


X X 


LOO 

H WW 


X 


97 


1 OA 


1 Q 

X-? 


X 


X 


'X'X 
JJ 


105 

1V/J 


X <J 


X 


X 


9A 


106 


11 


0 




90 


107 

X Vy / 


16 


^1 0 
jxu 


-Oil 

vl « X X 


91 


108 


16 


AIO 


-0 16 


1 7 


109 


17 






27 


110 


10 


420 

*t £. vy 


0 10 

v> « xvy 


14 


111 


22 




A 


9ft 


112 


20 


470 


-0 27 


91 


113 


27 


510 


0.04 


27 


1 1 A 




WO 


X 


o o 

zy 


115 


3 


680 


X 


18 


116 


15 


X 


X 


21 


117 


14 


440 


-0,03 


27 


118 


17 


420 


X 


37 


119 


27 


500 


-0.13 


34 


120 


18 


X 


X 


26 


121 


17 


410 


X 


22 


122 


23 


390 


-0.00 


33 


123 


17 


430 


X 


27 


124 


23 


520 


0.40 


37 


125 


12 


490 


X 


20 


126 


16 


500 


0.23 


26 


127 


24 


440 


X 


37 


128 


21 


380 


-0.17 


20 


129 


8 


300 


-0.04 


19 



12 




TABLE 5 



ANALYSIS OF COVARIANCE SUMMARY 
BlYTH ALGEBRA PRETEST AND POST TEST 



No. Cases Mean S.D. 



No* Cases Mean S.D. 



Blyth Algebra Pretest 
Blyth Algebra Post test 



31 
31 



19.39 6.30 
32.22 6.32 



29 
29 



17.34 5.81 
25.41 6.27 



Analysis of Covariance 
Source of variation df 
Among means 1 
Within groups 5 7 

SDy.x - 5.13 



ssy.x msy.x 

450.65 450.65 

1502.49 26.36 

Fy.x ■ 17.10 F 001 « 7.11 

Adjusted post test means due to analysis of covariance and regression 
equation : 



Mean post test a group 31.62 
Mean post test 3 group 26.06 

The difference 5.56 is significant by the F and T test at the .01 level. 



TABLE 6 

ANALYSIS OF COVARIANCE SUMMARY 
V SCORE AND BLYTH ALGEBRA POST TEST 







a 




8 




No, Cases 


Mean 


S.D. 


No. Cases 


Mean 


S.D. 


V Score 


18 


0.37 


.40 


14 


.01 


0.19 


Blyth Algebra Post 


test 18 


31.5 


6.53 


14 


24.36 


6.72 



F .oi = 7 - 60 



Analysis of Covariance 

Source of Variation df ssy.x msy.x 
Among means 1 127.31 127.31 

Within means 29 1159.38 39.98 

SDy.x « 6.32 Fy.x = 3.18 

Adjusted post test means due to analysis of covariance and regression 
equation: 

Mean post test a : 30.39 
Mean post test 3 : 25.74 

The difference 4.65 is not significant by F or T test '•.he .01 level. 
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TABLE 7 

ANALYSIS OF COVARIANCE SUMMERY 
CEEB MATH AND BLYTH ALGEBRA POST TEST 







a 


e 


No. Cases Mean S.D. 


No. Cases 


Mean 


S.D. 


CEEB Math 




24 481.67 82.87 


23 


443.91 


88.93 


Blyth Algebra Post test 




24 32.5 6.57 


23 


25.31 


6.78 


Analysis of Covariance 












Source of Variation 


df 


ssy.x msy.x 








Among means 


1 


528.16 528.1-': 








Within means 


44 


1946.16 44.2J 








SDy.x = 6.64 




Fy.x = 11.94 


F .oi 


= 7.25 





Adjusted post test means due to analysis of covariance and regression 
equation: 

Mean post test a : 32.26 
Mean post test : 25.38 

The difference 6*88 is significant by F and T test at the .01 level. 



TABLE 8 

F TEST FOR RATIO OF POST TEST VARIANCES 



2 2 
v - n s A n s c 



(n -l)a 2 (n -Do. 2 
a a B 3 



H : a = a, 
o a f 



H l : °a * °6 F .01 " 2 ' 47 



Since s a = 6.32 , n a = 31 

and Sg=6.27 ng=27 , 

then F = 1.01 and H Q was accepted 
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TABLE 9 

STATISTICAL ANALYSIS OF TIME DEVOTED TO COURSE 



Experiment Group a 
Control Group 6 



No. of Sample 
Cases Standard Deviation 



31 
29 



11.12 
10.16 



Sample Mean 



31.44 hours 
27.46 hours 



t = 



x a - Xg 



a 



n 



= 1.45 



: .0l 



= 2.71 



There is no significant difference in the means. 
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correlation of 0,632 between unit test average scores and post test 
scores for group g. This researcher was pleased with the correlations 
considering the fact that one set of tests was prepared by the authors 
of the audio-tutorial text and the other set of tests was prepared by 
the project director and both sets of tests were constructed using only 
face validity. 

The unit test average scores for each group were computed, A 
review of Table 10 indicates that the group mean of the experimental 
group a exceeded the control group 6 on 11 of the 14 units. This 
result is compatible with other results obtained in this study. 

The attitude survey had as its basic function the monitoring of 
the work of the student assistants, A copy of the attitude survey is 
included in Appendix E, Appendix E also provides detailed results of 
the survey. Thirty completed forms were received from group a and 
27 from group g. Although only raw data is given in the appendix the 
results were analyzed using a chi-square test. The results indicated 
that the student assistants 1 work was viewed as favorable but not 
outstanding, a performance that can be duplicated with senior mathe- 
matics majors on a regular basis. It is doubtfu] that the student 
assistants contributed significantly to the performance of the control 
group g. This is as it should be. The eight items relating to student 
assistants were answered only by group g participants. Forty-eight of 
the 57 students responding felt that the learning system was well 
organized and 46 thought it had many advantages over the lecture discus- 
sion technique used in other mathematics courses. The difficulty level 
of the material seemed appropriate and the attitude toward learning 
using the learning system in this experiment was very positive. The 
response to item 9 by group a was significantly different from the 
response by group g. Twenty-three of the 30 students responding in 
group a thought some of the mathematics topics should have been 
explained more thoroughly whereas only 9 of the 27 students responding in 
group g responded in a similar fashion. The problem sessions provide 
an explanation for the difference in the responses. Item 7 provided a 
check on item 9. Although the results are not as significant, 14 of the 
30 students responding from group a felt they did not receive an ade- 
quate explanation of each mathematics top^c whereas only 7 of the 27 
students responding in group g responded in a similar manner. 
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TABLE 10 

UNIT TEST AVP.RAGE SCORES BY GROUP 



Tin 4 t 


Experimental 

VJi. U Up CI 


Control 
Group 3 


1 

JL 


17.46 


17.30 


2 


17 7S 


17.56 




17 68 

JL / • W 


17.03 


A 
*t 


16.87 


16.13 




17 43 


17.00 


6 


16.21 


16.68 


7 


16.93 - 


16.62 


8 


17.59 


17.18 


9 


17.06 


16.38 


10 


17.31 


17.66 


11 


18.62 


17.91 


12 


18.45 


17.58 


13 


17.46 


17,54 


14 


16.64 


16.63 
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IV. CONCLUSIONS AND RECOMMENDATIONS 



Conclusions 

Two manageable and efficient audio-tutorial learning systems 
based on the audio-tutorial materials developed under Project 70 at 
Fullerton Junior College, Fullerton, California were developed in such 
a way that college students at Hendrix College learned mathematics skills 
associated with intermediate algebra at a level significantly above the 
national average as measured by the Blyth algebra test norms. The two 
learning systems were compared. Students receiving no help from student 
assistants but studying mathematics in a linearly ordered learning system 
under the direction of student assistants had mean scores significantly 
higher than the mean score of students receiving help from student 
assistants and studying mathematics in a linearly ordered learning system. 
Both group means were above the national average based on post test norms. 
The systems were organized by a member of the Hendrix College mathematics 
staff, otherwise no member of the staff was involved. The cost of teach- 
ing intermediate algebra was reduced from $60,00 to $32.00 per student. 
In addition to a reduction in cost per student, the mathematics teaching 
staff was free to devote more time to upper level courses. The program 
resulted in two desirable benefits for a small private liberal arts 
college; a saving in instructional cost and the development of a broader 
curriculum for mathematics majors. 

This researcher feels that students capable of directing their own 
learning of low level mathematics skills need reinforcement and guidelines 
for performance. Adequate research results are available from other 
sources to support this claim. However, a dependency relationship between 
students and instructor can cause a student to procrastinate and faulter 
in his work. The myth that one can master great numbers of skills in 
algebra during the last fev days of a course was definitely a factor in 
this experiment. Interviews with students in group g clearly show that 
most students felt that since help was available one could wait until the 
last few days of the term to finish the course. Most of the students did 
finish the course but with only superficial involvement. Learning was 
not accumulative and performance on the post test was poor. On the other 
hand, the attitude survey indicates there is a need for clarification of 
mathematical concepts not adequately covered in any set of instructional 
materials. Perhaps such assistance can be provided by student assistants 
and without the development of a dependency relationship between instruc- 
tor and student. Additional research is needed to investigate this 
matter. 
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. uyc, 



Re c omme nd a t i ons 



Small lib »ral arts colleges should gi ,? e serious consideration to 
the development •„ c audio-tutorial learning systems to be used in the 
teaching of low le 'el mathematics concepts. Concepts taught in conven- 
tional college algebra, modern mathematics for elementary teachers, and 
general education mathematics can be taught efficiently. Each college 
should develop its own learning system but use commercially produced 
materials whenever possible. Audio-tutorial materials are available and 
the state of technology related to Cassette players and filmstrip 
viewers is satisfactory. 

Student assistants should be junior or senior mathematics majors 
interested in teaching mathematics either at the high school or college 
level. The student assistar*ut> should direct the learning system with 
only limited involvement by the mathematics instructional staff. Student 
assistants should generally limit the^V role to administering and grading 
tests and the maintenance of records for evaluation purposes. However, 
clarification of concepts not adequately treated in the learning system 
should be permitted. 

It is further recommended that studies be made as to the feasibil- 
ity of incorporating audio-tutorial 35 millimeter slides and drill cards 
into an auc'io-tutorial learning system. Slides and drill cards might 
provide a way of giving a personal touch to the instructional materials 
by the mathematics staff in a specific college. This researcher is 
presently preparing a proposal which if funded would allow for the 
incorporation of 35 millimeter slides and drill cards into the learning 
system developed in this project. The intent is to add depth to the 
system to meet specific local needs. 
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DISCRIMINATORY ANALYSIS GUIDE 
FOR FRESHMEN PLACEMENT IN MATHEMATICS 
AT HENDRIX COLLEGE 



I, Statement of the Problem and Objectives 

Entering freshmen students at Hendrix College in the fall of 1971 
will be placed in one of our courses: precalculus mathematics, calcu- 
lus, contemporary mathematics, or Math Lab, The students are placed 
according to their past performances in high school mathematics courses, 
total grade point average, and college entrance examination scores. The 
placement procedure has emphasized an "intuitive feeling 11 about the 
student's potential mathematical ability rather than fully utilizing the 
data available. The purpose of this project is to make it possible to 
utilize four years of data in running a discriminatory analysis to 
properly place freshmen students in freshmen level courses in such a way 
as to maximize their chances for success in the course for which they 
are best qualified, 

II, Method of Research 

This researcher has maintained a detailed set of data on all 
entering freshmen since the fall of 1967, Each student's grades in high 
school mathematics courses, overall grade point average, College Entrance 
Board (CEEB) verbal and mathematics scores, and two standardized mathe- 
matics test scores have been available for statistical analysis. Also 
available were the grades each student made in his freshman mathematics 
courses: calculus, college algebra, and trigonometry. 

The statistical technique of discriminatory analysis was used to 
find the variables which best predicted a student's chances of success 
in each of the freshman mathematics courses. Success was defined as a 
predicted grade of C or better and failure was defined as a predicted 
grade of D or F, 

The discriminatory analysis was carried out using Olivetti Under- 
wood P101 and IBM 360-50 64K computers. The results consist of an 
equation involving five variables. The number generated by the equation 
is a prediction about a student's chances of success in either calculus 
or precalculus mathematics, 

III, Resume of Findings 
(a) Data characteristics 

Data was obtained on 1170 freshmen students who have entered 
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Hendrix College since 1967. Of these students, 313 were successful in 
freshman mathematics (A, B, or C in calculus, or A, B in college 
algebra) and 193 were not successful (D, F in calculus and C, D, F in 
college algebra). Complete data on six variables have been obtained. 
The variables are: (1) freshmen mathematics grades, (2) CEEB verbal 
scores, (3) CEEB mathematics scores, (4) overall high school grade 
poinL average, (5) a rating of mathematical grades and courses, and 
(6) a high school incentive quotient defined especially for this project , 

(b) The Discriminate Equation 

The biserial correlation coefficient is satisfactory for deter- 
mining the relationship between a dichotomized variable and one continu- 
ous variable, However, it is often desirable to predict a dichotomy 
from several numerical variables. Just as multiple regression yields 
appropriate weight for utilizing more than one variable in predicting a 
numerical criterion, so also an equation can be used in predicting a 
variable dichotomy. The latter equation is called a discriminant 
equation, A coefficient of multiple biserial R can be obtained from a 
discriminant equation and is similar to the coefficient of multiple 
correlation, 

A discriminant equation, originally developed by R, Z, Fisher, is 
very useful in ascertaining appropriate weights for a series of variables 
yielding maximum separation of two groups, each of which is assumed to be 
normally distributed. The equation may be expressed as 

V = a-^ + a 2 x 2 + + a m x m where x x , x 2 , ...3^ are continuous variables 

and a^, ••• a m are coefficients. The coefficients for the equation are 

found by solving a series of simultaneous equations similar to the normal 
equations used in multiple regression analysis. 

The discriminant equation lends itself to the prediction of success 
in a specific course and upon solution the output of the equation is in 
deviation form with a range of about -3 to +3* The equation can be 
changed from deviation form. 

The equation obtained in this study is in raw score form. An 
equation for placing students in freshman calculus mathematics was 
obtained using data on four freshman classes. The equation is 

V = 0,0008956 Xl + O,001098x 2 + 0,1898x 3 + 0,02525x 4 + O,01027x 5 - 2.3953, 
A student is placed using this equation only if he has successfully 
completed trigonometry. 

When applied to all students involved in the study the placement 
procedure was 84% accurate, 

V scores for students were obtained and cut off points were 
established so that the best accuracy could be obtained on 496 students 
whose grades in freshman mathematics we had obtained. Cut off V scores 
were selected so that the predictions coincided with the results as 
much as possible, A student with a V score of 1,29 or more will he 
strongly recommended for calculus, A student with a score from 0,68 to 
1,28 will be recommended for calculus, A student with a score from 0,51 



to 0,67 will be recommended for calculus with caution. 

An equation for placing students in freshman precalculus mathe- 
matics was obtained to be used in placing students without trigonometry. 
It yields a set of V scores that would be obtained from the calculus 
equation. The following equation is just as accurate for placement 
purposes as the calculus equation: V = 0,0008956x2 + 0.001098x 2 + 
0.1898x 3 + 0.02525x 4 + 0.01027x 5 - 1,9153. A student with a V score of 

0.50 or higher will be recommended for elementary functions. A student 
with a V score of 0.25 to 0.49 will be recommended for elementary 
functions with caution. A student with a V score of 0.24 or lower will 
be recommended for Math Lab or contemporary mathematics. 

It should be noted that the placement procedure outlined in this 
report results in a recommendation to the student and the student's 
advisor. A student will be encouraged to follow the recommendation, 
however one may feel his background is stronger or weaker than that 
indicated by the V score. Therefore, a student may actually enroll in 
Math Lab when it was recommended that the student take elementary 
functions. 
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APPENDIX B 
INTERMEDIATE ALGEBRA 
Topics Included in Learning Systems 



Unit 


1: 


Introduction to Sets 




Unit 


2: 


Graphs of the Number Line 




Unit 


3: 


Review of Field Properties - Part 


I 


Unit 


4: 


Review of Field Properties - Part 


II 


Unit 


5: 


Factoring 




Unit 


6: 


Fractions 




Unit 


7: 


Exponents 




Unit 


8: 


Radicals 




Unit 


9: 


Solution Sets of Linear Equations 




Unit 


10: 


Solution Sets of Quadratic Equations 


Unit 


11: 


Relations and Functions 




Unit 


12: 


The Linear Functions 




Unit 


13: 


The Quadratic Function 




Unit 


14: 


The Binomial Theorem 
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APPENDIX C 



TIME DEVOTED TO COURSE 



Experimental Group a 



Student Code 



Number of Hours 
Devoted to Course 



Control Group 6 



Student Code 



Number of Hours 
Devoted to Course 



1 




24.75 


2 




27.75 


3 




22.75 


4 




25.75 


5 




34.50 


6 




38.25 


I 




43.50 


8 




28.75 


9 




22.75 


10 




19.25 


11 




29.75 


12 




20.00 


13 




26.75 


14 




30.00 


15 




15.50 


16 




39.50 


17 




33.00 


18 




36.75 


19 




14.00 


20 




44.25 


21 




19.25 


22 




18.25 


23 




49.75 


24 




40.25 


25 




37.75 


26 




29.75 


27 




32.25 


28 




28.75 


29 




34.00 


30 




40.25 


31 




67.00 



10.1 


18.75 


102 


20.25 


103 


53.00 


104 


25.75 


105 


30.25 


106 


31.75 


107 


38.75 


108 


23.75 


109 


18.50 


110 


15.25 


111 


26.50 


112 


- 25.25 


113 


16.50 


114 


22.75 


115 


22.50 


116 


39.00 


117 


27.50 


118 


29.00 


119 


12.75 


120 


23.25 


121 


44.75 


122 


25.75 


123 


15.25 


124 


21.00 


125 


21.25 


126 


44.00 


127 


41.00 


128 


22.50 


129 


40.00 
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APPENDIX D 



FINAL GRADE ASSIGNMENT 



Experimental Group a Control Group 3 



Student Code 


Grade 


Student Code 


Grade 


1 


V 


101 


P 


2 


P 


102 


P 


3 


P 


103 


P 


4 


P 


104 


P 


5 


P 


105 


P 


6 


P 


106 


■kf 


7 


P 


107 


P 


8 


P 


108 


*F 


9 


*F 


109 


P 


10 


P 


110 


-F 


11 


P 


111 


P 


12 


P 


112 


P 


13 


P 


113 


P 


14 


P 


114 


P 


15 


P 


115 


* F 


16 


P 


116 


P 


17 


P 


117 


P 


18 


P 


118 


P 


19 


P 


119 


P 


20 


P 


120 


P 


21 


P 


121 


P - 


22 


P 


122 


P 


23 


P 


123 


P 


24 


P 


124 


P 


25 


P 


125 


P 


26 


P 


126 


P 


27 


P 


127 


P 


28 


P 


128 


P 


29 


P 


129 


P 


30 


P 






31 


P 







*A11 five students with grade of F failed to meet either of the two 
required criterias for passing; a score of 26 in the post test or 
complete 12 units with 70% score. 
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APPENDIX E 



PEARSON r CORRELATION COEFFICIENT 



Unit Test Average and Post test 
Experimental Group a Control Group 



Student 


Unit Test 


Post 


Student 


Unit Test 


Pos 


Code 


Average 


Test 


Code 


Average 


Tes 


1 


17.57 


33 


101 


16.42 


23 


2 


16.35 


25 


102 


15.64 


20 


3 


14.35 


21 


103 


16.50 


27 


4 


15.92 


24 


104 


17.85 


33 


5 


16.64 


40 


105 


16.21 


24 


6 


18.14 


35 


106 


15.40 


*20 


7 


17.20 


34 


107 


17.00 


21 


8 


17.28 


29 


108 


13.42 


*17 


9 


*17.09 


25 


109 


16.92 


27 


10 


18.64 


30 


110 


16.16 


*14 


11 


17.07 


32 


111 


18.00 


28 


12 


18.00 


37 


112 


17.85 


23 


13 


16.57 


24 


113 


17.00 


27 


14 


18.21 


35 


114 


18.14 


29 


15 


17.92 


41 


115 


15.00 


*18 


16 


17.00 


30 


116 


16.85 


21 


17 


17.35 


38 


117 


17.07 


27 


18 


17.64 


39 


118 


17.70 


37 


19 


18.57 


36 


119 


17.57 


34 


20 


14.07 


22 


120 


17.07 


26 


21 


16.07 


36 


121 


15.92 


22 


22 


18.92 


45 


122 


18.07 


33 


23 


16.85 


30 


123 


17.07 


27 


24 


17.15 


28 


124 


17.28 


37 


25 


15.92 


36 


125 


17.00 


20 


26 


16.91 


40 


126 


17.57 


26 


27 


. 15.85 


24 


127 


17.92 


37 


28 


17.35 


33 


128 


18.60 


20 


29 


15.35 


31 


129 


13.92 


19 


30 


17.50 


40 








31 


16.69 


25 









Pearson r = 0. 611 



Pearson r = 0.632 



*Based on fewer than 12 unit scores but more than 8, 
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APPENDIX F 



Experimental Group Date 

ATTITUDE SURVEY 

The items in this attitude survey are statements to which you are 
asked to indicate your immediate reaction. Check the appropriate square 
indicating your feeling. Please read the statements as quickly as 
possible and answer without much hesitation. Do not skip any questions 
unless it is clearly marked to be omitted by your group. 

1. The audio-tutorial text covered some topics which were new to me. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

o o o o o 

2. Some of the materials in the audio-tutorial text were too difficult. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 




o o n 

v,,,,/ 



3. I got bored working through the audio-tutorial text. 

Strongly Agree Undecided Disagree Strongly 

A 8 r ee Disagree 

O O ' O r\ 

4. Some of the materials in the audio-tutorial text were too easy. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 



t • *^ S 

\ i 1 



( ) n n 



5. I thought the learning system was well organized. 



Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

^♦***S f^'V 

U O O U C) 
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6. 



I can f t see much advantage of this system over the traditional 
lecture-discussion method of instruction. 




Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

o o o o . 

7. I received an adequate explanation of each mathematics topic. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

o o o o o 

8. Some of the material in the learning system was repetitious. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 



s ) I ) O ( ) 



9. Some of the mathematics topics should have been explained more 
thoroughly. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

o o o o o 

10. Intermediate algebra is very interesting. 

Strongly Agree Undecided Disagree Strongly 

Agree . Disagree 

o o o o o 

11. I enjoy doing my work alone. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

o o o o o 

12. I like variety in the ways of learning mathematics. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

o o o o o 
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13. 



The student assistants were qualified to manage the learning system. 



Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

o o o o o 

14. The student assistants presented the concepts at a level appropriate 

for students without previous knowledge of intermediate algebra. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 



o o o on 



15. The student assistants made little effort to prepare for the problem 
sessions . 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

O P) n o 

16. The student assistants were unable to hold my attention and interest 
in the problem sessions. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 







o 



o 



17. The problem sessions added value to the course. 



Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

(D O O O O 

18. I got bored during the problem sessions. 

Strongly Agree Undecided Disagree Strongly 

agree Disagree 

/"*\ /~\ 

^ w O vJ \.j 

19. I learned new ways of thinking about problems from discussions in 
problem sessions. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 




o 





32 



20. The problem sessions were not very helpful. 



Strongly Agree Undecided Disagree Strongly 

Agree Disagree 



o 




o o o 



21. I wouldn T t have understood the basic concepts of intermediate 
algebra without the problem sessions. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 



o o o o c 



) 



22. There are many advantages of this system as opposed to the lecture 
discussion technique used in other math courses. 

Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

U U kj o O 



n 
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APPENDIX F (Continued) 



ATTITUDE SURVEY RESULTS 

Item Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

1 a 9 16 0 4 1 

3 10 11 0 4 2 



2 a 1 4 4 11 10 

3 2 4 1 17 3 



3 a 1 7 7 12 3 

3 15 1 18 2 



4 a 1 4 10 l 

3 0 1 13 7 6 



5 a 16 9 3 2 0 

3 15 8 ? 2 0 



6 a 1 1 2 17 9 

3 2 0 2 12 11 



a 5 11 8 5 1 

3 4 16 3 3 1 



8 a 1 11 2 16 0 

3 15 1 18 2 



9 a 3 16 4 7.0 

3 0 3 6 14 4 



10 a 3 13 8 2 4 

3 6 8 6.7 0 



H « 6 14 3 3 2 

3 3 17 3 3 1 
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APFENDIX F (Continued) 

ATTITUDE SURVEY RESULTS 

Item Strongly Agree Undecided Disagree Strongly 

Agree Disagree 

12 a 7 15 6 0 2 

$ 7 17 1 2 0 

8 9 13 0 0 

B 9 13 5 0.0 



a x x x x x 

B 2 15 7 3 0 



, c a x x x x x 

B 0 1 13 7 6 



, , a x x x x x 

B 0 1 13 7 6 



17 a x x x x x 

3 10 7 8 1 1 



,o a x x x x x 

BOO 9 14 4 



,q a x x x x x 

B 2 9 10 5 1 



?n a x x x x x 

BO 3 6 14 4 



2-t a x x x x x 

B 2 4 13 6 2 

a 7 15 6 2 0 



22 



7 17 2 10 
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